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Abstract 


In  2005,  the  Canadian  Forces’  (CF)  Chief  of  Defence  Staff  announced  the  commencement  of  the 
transformation  of  the  CF.  As  with  any  complex  organization,  transformation  of  its  structure  and 
processes  is  not  simple.  However,  success  of  such  a  transition  “depends  upon  leadership  first  iden¬ 
tifying  and  understanding  the  thematic  components  of  the  past,  and  then,  learning  how  to  adapt  and 
exploit  the  thematic  strengths  ‘today’  for  the  benefit  of  ‘tomorrow’  While  several  themes  have 
been  identified  within  the  CF  transformation,  one  in  which  the  operational  research  community 
plays  a  vital  support  role  is  strategic  decision-making.  Strategic  decision-making,  in  the  context  of 
defence  acquisitions,  has  traditionally  been  described  as  a  reactive  process.  In  an  effort  to  migrate 
defence  acquisitions  towards  a  more  proactive  process,  a  rational  forward-looking  decision-making 
process  was  developed:  the  Force  Development  (FD)  process.  At  its  core  is  Capability  Based  Plan¬ 
ning  (CBP),  whose  analytical  process  and  associated  tools  provide  decision-makers  with  an  objec¬ 
tive  assessment  of  capability  deficiencies,  adequacies,  and  affluences.  This  objective  assessment 
is  central  to  the  following  defence  acquisition  trade-off  analysis,  whose  output  is  a  cost-effective 
strategic  capability  roadmap. 

The  FD  process  and  first  generation  CBP  analytical  process  have  been  recently  reported.  Devel¬ 
opment  of  the  second  generation  CBP  analytical  process  has  been  completed,  which  focused  on 
advancement  of  the  process  and  tools.  In  this  technical  memorandum  a  brief  summary  of  the  FD 
process  is  presented.  This  is  followed  by  an  overview  of  the  second  generation  CBP  analytical  pro¬ 
cess,  including  a  description  of  its  methods  with  an  emphasis  on  how  they  work  together  and  their 
advancements  since  the  first  generation. 


Resume 


En  2005,  le  Chef  d’etat-major  de  la  Defense  des  Forces  canadiennes  (FC)  a  annonce  le  debut  du 
processus  de  transformation  des  FC.  Conmie  pour  toute  organisation  complexe,  la  transformation  de 
la  structure  et  des  processus  n’est  pas  simple.  Toutefois,  pour  assurer  la  reussite  de  cette  transforma¬ 
tion,  « il  faudra  que  les  dirigeants  determinent  et  comprennent  les  elements  thematiques  du  passe  et 
qu’ils  apprennent  a  ensuite  adapter  et  a  exploiter  les  forces  thematiques  d’aujourd’hui  afin  de  creer 
des  occasions  pour  demain  ».  On  a  identifie  plusieurs  themes  dans  le  cadre  de  la  transformation 
des  FC,  dont  celui  de  la  prise  de  decisions  strategiques  ou  la  communaute  de  la  recherche  opera- 
tionnelle  joue  un  role  de  soutien  essentiel.  La  prise  de  decisions  strategiques  dans  le  domaine  des 
approvisionnements  pour  la  Defense  etait  generalement  decrite  conmie  un  processus  de  reaction. 
Dans  l’optique  de  rendre  le  processus  d’approvisionnement  de  la  Defense  plus  proactif,  on  a  cree 
un  processus  rationnel  de  decision  axe  sur  l’avenir  :  le  processus  de  developpement  des  forces  (DF). 
La  planification  fondee  sur  les  capacites  (PFC),  dont  le  processus  analytique  et  les  outils  connexes 
offrent  aux  decideurs  une  evaluation  objective  des  penuries,  des  niveaux  suffisants  et  des  surplus 
en  matiere  de  capacites,  est  au  cceur  de  ce  processus.  Cette  evaluation  objective  est  essentielle  pour 
effectuer  une  analyse  des  differentes  options  en  matiere  d’approvisionnement  pour  la  Defense,  puis 
creer  une  feuille  de  route  des  capacites  strategiques  rentables. 

Le  processus  DL  et  le  processus  analytique  PLC  de  premiere  generation  ont  fait  l'objet  d’un  rapport 
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recemment.  On  a  termine  F  elaboration  du  processus  analytique  PFC  de  deuxieme  generation  qui 
etait  axee  sur  le  developpement  du  processus  et  des  outils.  Dans  le  present  document  technique,  on 
decrit  brievement  le  processus  DF.  On  presente  egalement  un  aperqu  du  processus  analytique  PFC 
de  deuxieme  generation  dans  lequel  on  decrit  les  methodes  utilisees  en  precisant  notamment  com¬ 
ment  elles  se  completent  et  les  ameliorations  apportees  depuis  la  creation  du  processus  de  premiere 
generation. 
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2010. 

In  2005,  the  Canadian  Forces’  (CF)  Chief  of  Defence  Staff  announced  the  commencement  of  the 
transformation  of  the  CF.  As  with  any  complex  organization,  transformation  of  its  structure  and 
processes  is  not  simple.  Flowever,  success  of  such  a  transitions  “depends  upon  leadership  first  iden¬ 
tifying  and  understanding  the  thematic  components  of  the  past,  and  then,  learning  how  to  adapt  and 
exploit  the  thematic  strengths  ‘today’  for  the  benefit  of  ‘tomorrow’  ”  [1],  While  several  themes  have 
been  identified  within  the  CF  transformation,  one  is  in  which  the  operational  research  community 
plays  a  vital  support  role  is  strategic  decision-making. 


In  an  effort  to  migrate  the  CF  defence  acquisition  process  towards  one  that  is  more  proactive,  a 
forward-looking  decision-making  process  was  developed:  the  Force  Development  (FD)  process. 
The  FD  process,  shown  in  Figure  ES.  1,  employs  Capability  Based  Planning  (CBP),  whose  analytical 
process  and  associated  tools  provide  decision-makers  with  an  assessment  of  capability  deficiencies, 
adequacies,  and  affluences.  This  assessment  is  central  to  the  following  defence  acquisition  trade-off 
analysis  whose  output  is  a  cost-effective  strategic  capability  roadmap,  i.e.,  a  plan  describing  CF 
capability  development. 
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Figure  ES.1:  Canadian  Forces’  force  development  process. 


At  the  core  of  CBP  is  the  CBP  analytical  process,  which  is  comprised  of  a  set  of  soft  and  hard  op¬ 
erational  research  methods  that  collectively  implement  the  ‘Capability  Planning,  Management,  and 
Integration’  component  of  CBP.  The  CBP  analytical  process,  shown  in  Figure  ES.2,  is  segmented 
into  three  sections,  ‘capability  planning’,  ‘capability  management’,  and  ‘capability  integration’. 
The  process  is  comprised  of  inputs,  analytical  methods,  subject  matter  expert  analysis,  and  out¬ 
puts  that  are  represented  in  this  figure  by  beveled  boxes,  rectangles  with  headers,  rectangles,  and 
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rounded  rectangles  respectively.  While  the  five  analytical  methods,  i.e.,  CATCAM,  SC2RAT,  Con¬ 
currency,  Optimization,  Cost  Sensitivity,  have  been  modified  as  compared  to  their  predecessors, 
e.g.,  CATCAM  has  been  expanded  to  analyze  an  updated  capability  framework,  SC2RAT  replaces 
and  expands  three  previous  methods.  Concurrency  was  not  previously  included  in  the  process,  Opti¬ 
mization  investigates  the  quality  of  its  generated  solutions.  Cost  Sensitivity  employs  a  deterministic 
algorithm  rather  than  a  stochastic  algorithm,  the  goal  of  the  process  has  not  changed;  that  is  to 
generate  a  strategic  capability  roadmap. 


Figure  ES.2:  Second  generation  CBP  analytical  process.  Inputs  are  represented  by  beveled  boxes, 
analytical  methods  are  represented  by  rectangles  with  headers,  subject  matter  expert  analyses  are 
represented  by  rectangles,  and  outputs  are  represented  by  rounded  rectangles. 
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En  2005,  le  Chef  d’etat-major  de  la  Defense  des  Forces  canadiennes  (FC)  a  annonce  le  debut  du 
processus  de  transformation  des  FC.  Comme  pour  toute  organisation  complexe,  la  transformation 
de  la  structure  et  des  processus  n’est  pas  simple.  Toutefois,  pour  assurer  la  reussite  de  cette  trans¬ 
formation,  « il  faudra  que  les  dirigeants  determinent  et  comprennent  les  elements  thematiques  du 
passe  et  qu’ils  apprennent  a  ensuite  adapter  et  a  exploiter  les  forces  thematiques  d’aujourd’hui  afin 
de  creer  des  occasions  pour  demain  ».  On  a  identifie  plusieurs  thames  dans  le  cadre  de  la  transfor¬ 
mation  des  FC,  dont  celui  de  la  prise  de  decisions  strategiques  ou  la  communaute  de  la  recherche 
operationnelle  joue  un  role  de  soutien  essentiel. 

Dans  l'optique  de  rendre  le  processus  d'approvisionnement  de  la  Defense  des  FC  plus  proactif,  on  a 
cree  un  processus  rationnel  de  decision  axe  sur  l’avenir  :  le  processus  de  developpement  des  forces 
(DF).  Le  processus  DF,  illustre  au  Figure  Som.l,  comprend  la  planification  fondee  sur  les  capacites 
(PFC),  dont  le  processus  analytique  et  les  outils  connexes  offrent  aux  decideurs  une  evaluation 
objective  des  penuries,  des  niveaux  suffisants  et  des  surplus  en  matiere  de  capacites.  Cette  evaluation 
est  essentielle  pour  effectuer  une  analyse  des  differentes  options  en  matiere  d’approvisionnement 
pour  la  Defense  et  ensuite  creer  une  feuille  de  route  des  capacites  strategiques  rentables,  c’est-a-dire 
un  plan  decrivant  le  developpement  des  capacites  des  FC. 
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Figure  Som.  1:  Processus  de  developpement  des  forces  des  FC. 


Le  processus  analytique  PFC  est  au  cceur  de  la  planification  fondee  sur  les  capacites  (PFC).  II 
comprend  un  ensemble  de  methodes  de  recherche  operationnelle  objectives  et  subjectives  permet- 
tant  la  mise  en  ceuvre  du  volet  «  planification,  gestion  et  integration  des  capacites  »  de  la  PFC.  Le 
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processus  analytique  PFC  decrit  au  Figure  Som.2  se  divise  en  trois  sections  :  la  planification  des  ca¬ 
pacities,  la  gestion  des  capacites  et  F integration  des  capacites.  Le  processus  comprend  des  intrants, 
des  methodes  d’analyse,  des  analyses  d’experts  en  la  matiere  et  des  resultats  qui  sont  represented 
respectivement  dans  le  tableau  sous  forme  d’encadres  biseautes,  de  rectangles  avec  des  en-tetes,  de 
rectangles  et  de  rectangles  aux  coins  arrondis.  Bien  que  Ton  ait  modifie  les  cinq  methodes  d’ana¬ 
lyse,  a  savoir  l’EACMEC,  la  SC2RAT,  la  concuiTence,  F optimisation  et  l’elasticite  du  cout,  le  but 
du  processus,  c’est-a-dire  creer  une  feuille  de  route  des  capacites  strategiques,  demeure  le  meme. 
L’EACMEC  est  maintenant  plus  importante  pour  permettre  l’analyse  d’un  cadre  des  capacites  ac- 
tualise,  la  SC2RAT  remplace  et  ameliore  trois  methodes,  la  concuiTence  a  ete  integree  au  processus, 
l’optimisation  permet  d'evaluer  la  qualite  des  solutions  proposees  et  on  utilise  maintenant  un  algo- 
rithme  deterministe  plutot  qu’un  algorithme  stochastique  dans  le  cadre  de  la  methode  de  l’elasticite 
du  cout. 


Figure  Som.2:  Processus  analytique  PFC  de  deuxieme  generation.  Les  encadres  biseautes  re¬ 
presented  les  intrants,  les  rectangles  avec  les  en-tetes  represented  les  methodes  analytiques,  les 
rectangles  represented  les  analyses  des  experts  en  la  matiere  et  les  rectangles  aux  coins  arrondis 
represented  les  resultats. 
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1  Introduction 


1.1  Background 

In  2005,  the  Canadian  Forces’  (CF)  Chief  of  Defence  Staff  announced  the  commencement  of  the 
transformation  of  the  CF.  As  with  any  complex  organization,  transformation  of  its  structure  and 
processes  is  not  simple.  However,  success  of  such  a  transition  “depends  upon  leadership  first  iden¬ 
tifying  and  understanding  the  thematic  components  of  the  past,  and  then,  learning  how  to  adapt  and 
exploit  the  thematic  strengths  ‘today’  for  the  benefit  of  ‘tomorrow’  ”  [1],  Several  themes  have  been 
identified,  such  as  civil-military  relations,  individualism,  and  strategic  decision-making.  Strategic 
decision-making,  particularly  in  the  context  of  defence  acquisitions,  is  a  theme  in  which  the  opera¬ 
tional  research  community  plays  a  vital  support  role. 

Strategic  decision-making  for  defence  acquisitions  has  traditionally  been  a  reactive  process;  that  is 
basing  equipment  acquisitions  on  capabilities1  that  have  been  vital  or  unsatisfactory  during  previ¬ 
ous  CF  missions  [2] .  This  approach  was  previously  sufficient,  however  is  now  deemed  inadequate 
for  various  reasons,  such  as  the  diversity  of  military  operations,  e.g.,  domestic  and  continental 
operations,  reacting  to  a  major  terrorist  attack,  supporting  civilian  authorities  [3],  and  the  impor¬ 
tance  of  strong  financial  management  practices,  i.e.,  the  Department  of  National  Defence  may  only 
carry  forward  surplus  funds  equivalent  to  1%  of  its  yearly  budget  [4],  In  response,  the  Department 
has  migrated  its  strategic  decision-making  process  for  defence  acquisitions  from  a  reactive  one  to 
one  that  is  more  proactive:  the  Force  Development  (FD)  process.  At  its  core  is  Capability  Based 
Planning  (CBP)  [5],  which  consists  of  two  components:  ‘future  security  analysis’  and  ‘capability 
planning,  management,  and  integration’.  The  output  of  the  ‘future  security  analysis’  component  is 
a  set  of  force  planning  scenarios  that  describe  the  future  security  environment,  while  the  ‘capability 
planning,  management,  and  integration’  component,  which  is  implemented  by  an  analytical  process 
known  as  the  CBP  analytical  process,  uses  the  force  planning  scenarios  to  produce  an  assessment 
of  the  Department's  defence  capability  deficiencies,  adequacies,  and  affluences.  This  assessment 
is  central  to  the  following  defence  acquisition  trade-off  analysis,  whose  output  is  a  cost  effective 
strategic  capability  roadmap  (SCR),  i.e.,  a  plan  describing  CF  capability  development.  The  SCR  is 
key  element  in  the  transformation  of  the  strategic  decision-making  in  the  CF. 

1 .2  Objective 

The  objective  of  this  technical  memorandum  is  to  provide  an  overview  of  the  second  generation 
CBP  analytical  process2,  and  discuss  its  methods  and  how  they  compare  to  the  first  generation 
methods.  For  a  complete  description  of  the  first  generation  CBP  analytical  process,  including  its 
methods,  the  reader  is  referred  to  previous  papers  by  Billyard  and  Blakeney  [6],  Blakeney  et.  al. 
[7,  8],  Taylor  et.  al.  [9],  and  Christopher  et.  al.  [10].  As  well,  complete  descriptions  of  each 

1 A  capability  may  be  defined  as  “A  particular  ability  that  contributes  to  the  production  of  a  desired  effect  in  a  given 
environment  within  a  specified  time  and  the  sustainment  of  the  effect  for  a  designated  period.  Capability  is  delivered  by 
an  appropriate  combination  of  PRICIE  components”  [2],  PRICIE  refers  to  the  functional  components  of  a  capability:  Per¬ 
sonnel/Leadership/Individual  training,  Research  and  Development/Operations  Research,  Infrastructure,  Environment  and 
Organization,  Concepts,  Doctrine,  Collective  Training,  Information  Management  &  Technology  &  Equipment  Support. 

2It  should  be  noted  that  the  first  generation  CBP  analytical  process  was  known  as  the  SCR  analytical  framework.  The 
name  has  been  changed  to  emphasize  the  process  rather  than  the  output. 
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second  generation  CBP  analytical  method  arc  published  individually  in  existing,  e.g.,  [11],  or  will 
be  published  in  forthcoming  Defence  Research  and  Development  Canada  technical  memoranda. 

Three  items  should  be  noted  with  respect  to  the  scope  of  this  work.  First,  it  is  the  purpose  of  this 
technical  memorandum  to  present  the  state-of-the-art  CBP  analytical  process  and  discuss  its  meth¬ 
ods,  rather  than  the  results  produced  through  executing  the  process.  For  information  regarding  the 
results  of  executing  the  CBP  analytical  process,  the  reader  should  contact  the  Directorate  of  Mili¬ 
tary  Capability  Management  (see  http :  //cf  d  .mil .  ca).  Second,  the  focus  of  the  CBP  analytical 
process  presented  is  limited  to  the  analysis  of  force  employment  capabilities,  i.e.,  capabilities  that 
arc  employed  during  operations.  While  the  CF  possess  capabilities  within  the  force  generation  and 
force  development  domains,  these  capabilities  arc  not  currently  studied  within  the  CBP  analytical 
process.  Third,  CBP  exists  within  the  larger  FD  process,  which  in  turn  exists  within  the  CF/DND 
strategic  decision-making  governance  structure.  While  it  is  important  to  be  cognisant  of  the  gover¬ 
nance  structure,  i.e.,  the  results  of  the  CBP  process  are  utilized  throughout  the  governance  structure 
shown  in  Figure  1 ,  it  will  not  be  discussed  in  this  technical  memorandum.  For  further  information 
on  the  structure,  the  reader  is  referred  to  the  Capability  Based  Planning  handbook  [2]. 
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Figure  1:  CF/DND  strategic  decision-making  governance  structure.  The  lower  four 
boards/committees  are  chaired  by  the  Vice  Chief  of  Defence  Staff  and  the  upper  three  commit- 
tee/councils  are  co-chaircd  by  the  Deputy  Minister  and  Chief  of  Defence  Staff. 
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1.3  Outline 


The  remainder  of  this  technical  memorandum  is  organized  as  follows:  Section  2  presents  an  overview 
of  the  FD  process,  which  is  presented  to  provide  a  context  for  the  CBP  analytical  process;  Section 
3  presents  an  overview  of  the  second  generation  CBP  analytical  process  and  its  methods,  and  high¬ 
lights  modifications  of  each  method  since  the  first  generation;  and  Section  4  presents  a  conclusion. 


DRDC  CORA  TM  2010-198 


3 


2  Force  Development  Process 


The  strategic  decision-making  process  for  defence  acquisitions  is  a  key  process  within  any  mod¬ 
ern  military.  The  CF,  in  an  effort  to  migrate  its  process  towards  a  proactive  one,  has  designed  and 
implemented  an  end-to-end  process  that  uses  government  strategic  guidance  as  its  input  and  as  its 
output  generates  employable  force  elements3  for  the  CF  operational  commands:  the  Force  Devel¬ 
opment  process.  The  FD  process4  is  shown  in  Figure  2.  While  several  feedback  mechanisms  exist 
within  the  process,  two  key  loops  arc  those  between  the  ‘Capability  Based  Planning’  and  ‘Strategic 
Guidance’  components  and  the  ‘Key  Products’  and  ‘Capability  Based  Planning’  components.  It 
should  be  noted  that  the  SCR,  which  is  envisioned  as  a  key  element  for  transformation  of  strategic 
decision-making  within  the  CF,  exists  within  the  ‘Key  Products’  segment  and  is  a  product  of  the 
‘Capability  Based  Planning’  component. 
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Figure  2:  Canadian  Forces’  force  development  process. 


The  FD  process  begins  with  an  assessment  of  strategic  guidance,  such  as  foreign  and  defence  policy, 
e.g.,  Canada  First  Defence  Strategy  [3],  and  defence  directives  from  senior  military  and  civilian 
leadership.  This  guidance,  which  describes  cuiTent  and  future  defence  and  security  priorities,  forms 
the  input  to  the  CBP  component. 

The  CBP  component  is  split  into  two  segments:  ‘future  security  analysis’  and  ‘capability  planning, 
management,  and  integration’.  The  ‘future  security  analysis’  segment  evaluates  the  future  security 
environment  and  generates  force  planning  scenarios3  that  represent  operations  the  CF  is  likely  to 
be  engaged  in  given  the  strategic  guidance.  In  conjunction  with  the  force  planning  scenarios,  there 
exists  a  capability  framework  that  describes  the  full  spectrum  of  military  capabilities  that  the  CF 
either  has,  may  have  in  the  future,  or  neither  but  arc  required  by  the  scenarios.  The  force  planning 

3  A  force  element  is  defined  as  a  fundamental  unit  within  the  CF  that  can  be  utilized  to  provide  capability  within  an 
operation.  The  unit  may  perform  a  tactical,  operational,  or  strategic  level  function  [10].  Examples  of  force  elements  are 
one  CC-177,  one  fixed-wing  search  and  rescue  aircraft,  or  one  engineer  field  squadron. 

4The  CF  FD  process  is  a  waterfall  model,  i.e..  sequential  development  process,  with  feedback. 

5The  force  planning  scenarios  depict  a  range  of  domestic,  continental,  and  international  events  and  possibilities  across 
the  full  spectrum  of  conflict  [2]. 
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scenarios  and  capability  framework,  which  provides  a  common  language  to  discuss  CF  capabilities, 
form  the  input  to  the  ‘capability  planning,  management,  and  integration’  component. 

The  ‘capability  planning,  management,  and  integration’  segment,  which  is  the  analytical  engine  of 
CBP,  is  further  divided  into  three  elements:  ‘capability  planning’,  ‘capability  management’,  and 
‘capability  integration’.  The  ‘capability  planning’  component  describes  the  capability  framework 
elements6  that  the  force  planning  scenarios  require.  This  process  begins  with  an  evaluation  of 
standardized  effects7  within  each  scenario.  Subsequently,  the  capability  framework  elements  arc 
evaluated  to  determine  if  they  arc  able  to  create  each  effect.  Along  with  the  evaluation,  a  set  of 
questions,  known  as  measures  of  capability,  arc  created  for  each  capability  framework  element. 
The  purpose  of  the  measures  of  capability  is  to  further  quantify  and  qualify  the  role  of  the  element 
within  the  scenario. 

The  ‘capability  management’  component,  which  is  the  follow-on  process  to  ‘capability  planning’, 
determines  how  the  CF  will  provide  the  aforementioned  capability  framework  elements  within  each 
scenario.  The  process  begins  by  comparing  the  capability  framework  element  requirements  with 
existing  and  programmed  operational  force  elements  over  time  for  each  scenario  and  subsequently 
assigning  force  elements  to  framework  elements.  The  scenarios’  force  element  requirements  arc 
combined  together  to  form  concurrent  scenario  force  element  requirements.  This  information  is 
summarized  in  two  interim  results,  a  capability  outlook  and  a  risk  outlook.  The  capability  outlook 
provides  a  high-level  view  of  the  potential  of  the  existing  and  programmed  operational  force  ele¬ 
ments  to  achieve  individual  scenario  capability  framework  element  requirements  over  time.  The 
risk  outlook  provides  a  view  of  the  operational  risk  to  the  success  of  a  scenario,  and  combination  of 
scenarios,  i.e.,  concurrent  scenarios.  These  two  interim  outputs  provide  the  basis  for  the  determina¬ 
tion  of  the  set  of  CF  capability  deficiencies,  which  arc  those  capability  framework  elements  that  do 
not  have  adequate  force  elements  assigned. 

While  the  capability  and  risk  outlooks  aid  the  understanding  of  the  capability  deficiencies,  they  do 
not  provide  insight  into  how  to  address  them.  This  is  performed  in  the  ‘capability  integration’,  i.e., 
integration  of  alternatives  to  address  capability  deficiencies  with  the  existing  investment  plan,  com¬ 
ponent  through  a  three  step  procedure:  determination  of  alternatives8  to  address  each  deficiency; 
selection  of  a  set  of  alternatives;  and  review/approval  of  selected  alternatives  by  decision-makers. 
The  set  of  approved  alternatives  for  the  deficiencies  analyzed  arc  one  of  the  key  inputs  to  the  SCR. 

The  key  products  of  the  FD  process  arc:  SCR,  investment  plan,  and  the  defence  plan.  The  SCR, 
which  is  the  direct  output  of  the  CBP  component,  is  the  aforementioned  list  of  approved  alternatives 
as  well  as  government  approved  initiatives,  e.g.,  as  extracted  from  the  Canada  First  Defence  Strategy 
[3].  The  alternatives  arc  ranked  based  on  a  variety  of  metrics,  such  as  cost,  military  value,  and 
personnel  requirements.  As  well,  each  alternative  and  government  initiative  is  mapped  to  a  set  of 
tangible  projects.  These  projects,  along  with  a  proposed  implementation  schedule,  form  the  input 

6The  capability  framework  is  a  hierarchical  structure  and  each  level  is  comprised  of  a  set  of  elements.  A  level  within 
the  capability  framework,  e.g.,  level  4,  is  selected  to  perform  the  analysis  throughout  the  analytical  process. 

7An  effect  is  defined  s  a  physical,  functional,  or  psychological  outcome,  event,  or  consequence  that  results  from  the 
execution  of  specific  tasks  [2], 

8  Alternatives  are  options  to  address  capability  deficiencies,  such  as  the  purchase  of  equipment,  addition  of  personnel, 
or  research  and  development  projects. 
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to  the  investment  plan.  The  final  key  product,  the  defence  plan,  is  a  business  plan  that  provides 
defence  tasks  and  resource  allocation.  It  is  primarily  a  management  tool  that  integrates  priorities, 
vision,  and  policy. 

The  key  products  described  above  articulate  the  required  capabilities  of  the  CF  and  how  to  address 
them,  however  they  are  not  the  final  output.  The  measurable  effects,  which  arc  those  created  by  the 
Army,  Navy,  and  Air  Force,  as  well  as  the  generated  employable  force  elements  arc  the  final  output 
of  the  system,  i.e.,  force  development,  force  generation,  force  employment,  as  a  whole.  It  is  these 
effects  that  determine  the  overall  success,  or  failure,  of  the  system. 

The  feed  forward  path,  i.e.,  strategic  guidance  — >  capability  based  planning  — >  . . .,  is  the  primary 
path  in  the  FD  process;  however,  the  feedback  paths  play  an  important  role  as  well.  The  role  of  the 
feedback  paths  is  to  provide  the  ability  to  apply  corrective  action,  e.g.,  modifying  strategic  guidance, 
removal  of  a  capability  deficiency,  within  the  FD  process.  For  example,  the  feedback  path  between 
‘capability  based  planning’  and  ‘strategic  guidance’  recognizes  that  the  capability  based  planning 
process  may  influence  the  strategic  direction  provided  by  the  government.  As  well,  the  feedback 
path  between  the  ‘key  products’  and  ‘capability  based  panning’  recognizes  that  the  investment  plan 
is  not  static,  due  to  changing  project  timelines  and  funding,  and  subsequently  impacts  the  selection 
of  alternatives  to  address  capability  deficiencies. 
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3  Capability  Based  Planning  Analytical  Process 


The  core  of  the  FD  process,  as  described  in  the  previous  section,  is  CBP.  The  CBP  component, 
which  is  further  divided  into  ‘future  security  analysis’  and  ‘capability  planning,  management,  and 
integration’,  transforms  its  inputs,  i.e.,  foreign  policy,  defence  policy,  into  a  capability  roadmap 
through  applying  soft,  e.g.,  subjective  analysis  of  effects  and  capability  framework  elements  in 
scenarios,  and  hard,  e.g.,  optimization  of  alternatives  to  address  capability  deficiencies,  operational 
research  techniques.  The  ‘capability  planning,  management,  and  integration  component’  is  the 
analytical  engine  of  CBP  and  is  implemented  through  the  CBP  analytical  process.  The  second 
generation  CBP  analytical  process  is  based  on  its  predecessor  [8,  9,  10],  which  in  turn  is  based  on 
the  generic  process  proposed  by  The  Technical  Cooperation  Program  Joint  Systems  and  Analysis 
Group  Technical  Panel  3  [12]  and  Burton  et.  al  [13].  While  similar  to  previous  work,  the  second 
generation  introduces  new  methods  and  modifications  to  existing  methods. 

3.1  Overview 

The  CBP  analytical  process  is  comprised  of  a  set  of  soft  and  hard  operational  research  methods  that 
collectively  implement  the  second  component  of  CBP,  which  is  ‘capability  planning,  management, 
and  integration’.  The  process,  shown  in  Figure  3,  is  segmented  into  three  sections,  ‘capability  plan¬ 
ning’,  ‘capability  management’,  and  ‘capability  integration’.  The  process  is  comprised  of  inputs, 
analytical  methods,  subject  matter  expert  analysis,  and  outputs  that  are  represented  in  this  figure  by 
beveled  boxes,  rectangles  with  headers,  rectangles,  and  rounded  rectangles  respectively.  There  arc 
five  analytical  methods,  i.e.,  CATCAM,  SC2,RAT,  Concurrency,  Optimization,  and  Cost  Sensitivity, 
and  two  subject  matter  expert  analyses,  i.e.,  risk  outlook  and  alternative  to  project  mapping.  Each 
method  within  the  process  is  either  new,  modified,  or  has  been  further  investigated  as  compared 
to  the  first  generation  methods.  The  second  generation  modifications  to  the  analytical  methods  arc 
summarized  as  follows: 

•  CATCAM  has  the  ability  to  analyze  multiple  levels  within  the  capability  framework; 

•  SC2RAT  replaces  three  first  generation  methods; 

•  Concurrency  is  new  and  did  not  exist  in  the  first  generation; 

•  Optimization  has  been  further  investigated  to  gauge  the  quality  of  its  generation  solutions; 
and 

•  Cost  Sensitivity  has  been  modified  to  employ  a  deterministic  algorithm  rather  than  one  that 
is  stochastic. 

The  remainder  of  Section  3  provides  an  overview  of  each  analytical  method,  including  their  in¬ 
puts,  outputs,  and  modifications  since  the  previous  generation.  The  risk  outlook  is  discussed  in  the 
Concurrency  section  and  alternative  to  project  mapping  is  discussed  in  the  Cost  Sensitivity  section. 
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Figure  3:  Second  generation  CBP  analytical  process.  Inputs  are  represented  by  beveled  boxes, 
analytical  methods  are  represented  by  rectangles  with  headers,  subject  matter  expert  analyses  are 
represented  by  rectangles,  and  outputs  are  represented  by  rounded  rectangles. 


3.2  CATCAM 

CATCAM  [6,  14],  that  is  the  Chief  of  Defence  Staff  Action  Team  3  Capability  Assessment  Method¬ 
ology,  is  a  key  operational  research  tool  in  the  CBP  analytical  process.  Its  primary  purpose  is  to 
evaluate  and  prioritize  the  capability  framework  elements  within  force  planning  scenarios.  The  ca¬ 
pability  framework  is  a  hierarchical  structure,  where  each  level  is  comprised  of  a  set  of  elements 
and  each  successive  lower  level  provides  a  greater  degree  of  fidelity,  i.e.,  an  element  in  level  1  of  the 
structure  may  be  divided  into  three  elements  in  level  2,  and  each  may  be  further  divided  in  level  3. 
An  example  segment  of  the  capability  framework  is  shown  in  Figure  4,  where  the  levels  arc  labeled 
as  ‘Domain’,  ‘Capability’,  ‘Function’,  ‘Activity’,  and  ‘Subactivity’. 

The  analysis  performed  using  CATCAM  begins  by  subject  matter  experts  assessing  each  of  six 
standardized  mission  effects,  i.e.,  control,  shape,  stabilize,  shield,  project  and  sustain,  and  informed 
direction  [2],  with  respect  to  their  required  frequency  and  the  consequence  if  the  effect  is  not  created 
within  each  scenario.  Subsequently,  subject  matter  experts  assess  the  capability  framework  elements 
that  are  required  to  create  the  effects  through  the  elements’  required  frequency  and  the  consequence 
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Figure  4:  Capability  framework  example. 


if  the  elements  can  not  create  the  effects9.  For  example.  Figure  5  shows  a  segment  of  the  CATCAM 
method  in  which  the  ‘Control’  effect  is  assessed  to  have  a  high  frequency  and  high  consequence, 
i.e.,  as  indicated  by  an  ‘hh’  for  high  frequency  and  high  consequence  under  the  ‘Control’  effect,  and 
the  ‘Deny  Portions  of  the  Sea’  framework  element  is  assessed  to  have  a  low  frequency  and  medium 
consequence  with  respect  to  the  ‘Control’  effect,  i.e.,  as  indicated  by  a  ‘lm’  for  low  frequency  and 
medium  consequence,  for  the  given  scenario.  The  assessments  arc  converted  into  numerical  scores, 
and  an  overall  score  for  each  capability  framework  element  across  the  effects  is  calculated  using 
a  weighted  sum10  based  on  normalized  mission  effect  scores  [6].  The  set  of  numerical  scores11, 
as  described  by  Bill  yard  and  Blakeney  [6],  for  each  scenario  is  passed  between  the  ‘capability 
planning’  and  ‘capability  management’  components.  As  well,  a  set  of  questions,  known  as  measures 
of  capability,  are  provided  with  each  assessment.  The  purpose  of  the  measures  of  capability  is  to 
further  quantify  and  qualify  the  role  of  the  capability  framework  elements  throughout  the  scenarios. 

The  algorithms  within  the  second  generation  CATCAM  tool  are  similar  to  those  employed  in  the 
first  generation;  however,  modifications  were  made  to  accommodate  for  an  extended  capability 
framework.  Whereas  the  first  generation  capability  framework  consisted  of  four  levels,  i.e.,  Do¬ 
main  — >  Capability  — >  Function  — ■»  Activity,  the  second  generation  capability  framework  included 
a  fifth  level,  i.e.,  Subactivity,  in  order  to  provide  a  greater  degree  of  fidelity  throughout  the  CBP 
analytical  process.  In  order  to  accommodate  the  fifth  level,  and  allow  a  comparison  with  first  gener¬ 
ation  results,  i.e.,  the  Activity  level  of  the  capability  framework  was  assessed  in  the  first  generation, 
the  capability  framework  element  assessments  were  performed  in  two  stages.  The  elements  in  the 
Activity  level  were  evaluated  in  an  identical  manner  as  to  those  in  the  first  generation.  However, 

9It  should  be  noted  that  capability  framework  elements  can  be  labeled  as  ‘enablers’;  that  is,  they  do  not  deliver  an 
effect  themselves,  rather  they  enable  other  framework  elements  to  deliver  an  effect  [14]. 

1HIt  should  be  noted  that  the  calculation  assumes  that  the  effects  are  orthogonal;  that  is  the  evaluation  of  one  effect 
does  not  influence  the  evaluation  of  a  second  effect. 

1 1  The  numerical  scores  may  be  used  to  create  a  prioritized  list  of  capabilities  for  each  scenario. 
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Figure  5:  Example  segment  of  CATCAM  with  sample  data. 


the  elements  in  the  Subactivitiy  level  were  evaluated  with  respect  to  their  associated  Activity  level 
elements  rather  than  the  effects,  i.e.,  the  frequency  with  which  the  Subactivity  is  required  to  per¬ 
form  the  Activity  and  the  consequence  the  Activity  can  not  be  performed  if  the  Subactivity  can  not 
be  performed.  The  Subactivity  scores  were  computed  in  a  similar  manner  to  the  Activity  scores, 
however  rather  than  being  weighted  by  the  effects  they  were  weighted  by  their  associated  Activ¬ 
ity.  Thus,  the  ‘capability  planning’  component  of  the  CBP  analytical  process  passed  Activity  and 
Subactivity  scores  to  the  ‘capability  management’  component. 

3.3  SC2RAT 

The  Scenario  Capability/Capacity  Requirements  Assessment  and  Outlook  Tool  (SC2RAT)  is  the 
follow-on  method  to  CATCAM.  SC2RAT,  which  uses  the  capability  framework  element  scores 
determined  in  CATCAM,  existing  and  future  programmed  operational  force  structure,  and  force 
element  rotation  ratios  as  input,  generates  a  capability  outlook  that  effectively  describes  the  health 
of  the  CF  capabilities  over  time  for  each  force  planning  scenario.  This  is  accomplished  through  a 
three  step  procedure:  first,  subject  matter  experts  evaluate  the  types  and  number  of  force  elements 
required  to  perform  the  Subactivities12;  second,  operational  force  elements  arc  assigned  to  Subac¬ 
tivities  based  upon  a  set  of  rules,  e.g.,  force  elements  are  assigned  to  higher  ranked  Subactivities 
first;  and  third,  generation  of  a  capability  outlook  for  each  scenario,  which  is  a  summary  of  the 
capability  adequacies  and  deficiencies.  The  first  and  second  steps  are  required  for  each  time  period 
studied  where  there  is  a  change  in  the  operational  force  structure. 

An  example  of  a  segment  of  SC2RAT  for  a  single  scenario  and  time  period  is  shown  in  Figure  6.  The 
capability  framework  and  the  Subactivity  scores  are  shown  in  the  left  portion  of  the  tool  and  across 

'-Any  capability  framework  level  could  be  analyzed,  however  the  second  generation  CBP  analytical  process  used  the 
Subactivity  level  as  described  in  Section  3.2. 
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the  top  is  the  required  scenario  information,  i.e.,  duration,  rotation  length,  and  the  force  structure, 
i.e.,  force  element  types,  quantity,  rotation  ratio,  for  the  given  time  period.  The  lower  right  portion 
provides  the  ability  for  subject  matter  experts  to  perform  the  first  step  in  the  procedure;  that  is,  to 
evaluate  the  type  and  number  of  force  elements  required  for  each  Subactivity.  There  are  two  types 
of  evaluations:  primary  and  secondary.  A  primary  evaluation  is  the  number  of  force  elements  of  a 
type  required  from  those  available  in  the  force  structure  for  a  single  rotation  to  perform  a  Subac¬ 
tivity.  A  secondary  evaluation  is  similar  to  a  primary  evaluation,  however  rather  than  requiring  the 
force  elements  from  the  force  structure  the  force  elements  are  required  from  an  identified  primary 
evaluation.  The  puipose  of  the  secondary  evaluation  is  to  allow  the  tool  to  reflect  the  reality  that 
a  set  of  force  elements  may  perform  more  than  one  subactivity.  As  a  guide  to  the  evaluations,  the 
measures  of  capability  provided  from  CATCAM  are  used  to  assist  the  subject  matter  experts  during 
the  evaluations.  As  an  example,  ‘Conduct  CANUS  initial  planning’  is  a  primary  evaluation  that 
requires  two  force  elements  of  type  FE1  and  ‘Conduct  strategic  and  operational’  is  a  secondary 
evaluation,  i.e.,  linked  to  Subactivity  1.1. 1.1.4,  that  requires  one  force  element  of  type  FE1.  The 
number  of  force  elements  required  for  a  secondary  evaluation  must  be  less  than  or  equal  to  that  in 
the  associated  primary  evaluation. 


MM-  Q 

|m  <  ►  Hi\SC2RAT  / 

1  1  1  9  R  Pnnrtnrt  hinh-lpy^l  yitprpnpnrv  .trl  1 
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NUM 

Figure  6:  Example  segment  of  SC2RAT  with  sample  data  for  a  single  scenario  and  single  time 
period.  The  segment  does  not  show  the  entire  capability  framework  or  force  element  set  for  the 
time  period. 


The  second  step  in  the  procedure,  which  is  the  assignment  of  force  elements  to  Subactivities,  is 
performed  after  all  Subactivities  have  been  evaluated  by  subject  matter  experts.  The  assignment 
heuristic  assigns  force  elements  to  Subactivities  based  on  their  score,  i.e.,  greedy  algorithm;  that 
is,  force  elements  are  assigned  to  the  Subactivities  with  the  highest  CATCAM  score  with  a  pri¬ 
mary  evaluation  first,  the  second  highest  CATCAM  score  with  a  primary  evaluation  second,  and  so 
forth.  During  each  assignment  the  number  of  required  force  elements  is  checked  against  the  force 
structure;  if  there  are  enough  force  elements  available,  then  the  number  required  is  removed  from 
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those  available  and  the  Subactivity  is  labeled  green13,  i.e.,  adequate  capability,  else  if  there  are  not 
enough  force  elements  available  the  Subactivity  is  labeled  red,  i.e.,  deficient  capability,  and  the  re¬ 
quired  force  elements  are  not  removed  from  those  available.  This  assignment  heuristic  is  repeated 
for  each  Subactivity,  however  once  a  Subactivity  is  labeled  red  further  force  element  assignments 
are  not  performed  for  that  Subactivity.  It  should  be  noted  that  all  the  force  elements  required  for  a 
Subactivity  must  be  available  and  assigned  for  the  Subactivity  to  be  labeled  green;  however,  the  lack 
of  a  single  force  element  will  cause  the  Subactivity  to  be  labeled  red.  The  secondary  evaluations 
are  not  assessed  in  the  assignment  heuristic,  and  thus  are  assessed  to  be  green. 


The  final  step  of  the  procedure  is  the  generation  of  a  capability  outlook  for  each  scenario.  An 
example  is  shown  in  Figure  7.  The  outlook  for  each  year  for  each  Subactivity  is  taken  directly 
from  SC2RAT,  and  these  arc  subsequently  aggregated  to  higher-levels  in  the  capability  framework. 
The  aggregation  algorithm  is  based  on  degradation,  i.e.,  a  combination  of  geometric  and  additive 
aggregation  techniques  are  employed,  caused  by  lower  level  deficiencies,  and  each  aggregation  is 
assigned  a  color,  i.e.,  red,  yellow,  green,  based  on  the  degree  of  degradation,  i.e.,  Subactivity  1. 1. 1.6 
degrades  Activity  1.1.1  sufficiently  that  is  is  deemed  a  deficiency  in  2009. 


3  Conduct  CANUS  coord  planning 


Figure  7:  Example  segment  of  the  capability  outlook. 


SC2RAT  effectively  replaces  three  methods  from  the  first  generation  CBP  analytical  process:  the 
Force  Generation  and  Evaluation  (FoRGE)  tool  [7,  10],  the  Capability  Outlook  Tool  [15],  and  the 
Activity-Based  Neoteric  Deficiency  Ranking  and  Evaluation  Workbook  (ANDREW)  [10].  FoRGE 
provided  a  similar  construct  as  SC2RAT  for  evaluating  the  set  of  force  elements  that  could  provide  a 
given  capability.  However,  rather  than  a  specific  number  of  force  elements,  FoRGE  simply  allowed 
subject  matter  experts  to  indicate  if  a  force  element  could  or  could  not  provide  a  given  capability 
framework  element.  While  FoRGE  identified  which  force  elements  could  be  utilized,  it  did  not 
account  for  the  capacity  of  force  elements  required  as  SC2RAT  does.  Following  this  analysis,  the 
Capability  Outlook  Tool  transformed  the  data  collected  from  FoRGE  into  a  capability  outlook, 
similar  to  the  output  generated  by  SC2RAT  as  shown  in  Figure  7.  Using  the  capability  outlook,  in 
a  similar  method  as  to  that  used  in  the  second  generation,  subject  matter  experts  created  a  list  of 
capability  deficiencies.  ANDREW  was  then  used  to  prioritize  the  deficiencies,  based  on  their  level 
of  impact  to  perform  the  capability  framework  elements  in  the  scenarios.  This  assessment  is  now 
provided  through  the  degradation  calculations  in  SC2RAT. 

I3See  column  E  in  Figure  6. 
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3.4  Concurrency 


While  SC2RAT  investigates  the  force  element  requirements  of  individual  scenarios,  and  subse¬ 
quently  the  health  of  the  required  capability  framework  elements  through  the  capability  outlook, 
it  does  not  investigate  the  force  element  requirements  of  concurrent  scenarios.  The  Concurrency 
method  [11]  provides  this  insight  through  assessing  the  force  element  requirements  of  concurrent 
scenarios  and  comparing  those  to  the  current  and  programmed  force  structure.  This  is  done  through 
a  three  step  process:  first,  calculation  of  the  total  force  elements  required,  including  rotations,  for 
each  scenario;  second,  calculation  of  the  force  elements  required  for  combinations  of  scenarios; 
and  third,  determination  of  force  element  deficiencies  and  affluences  as  a  function  of  scenario  con¬ 
currency  and  risk  tolerance.  There  arc  three  levels  of  risk  tolerance  that  affect  the  force  elements 
required  for  a  set  of  concurrent  scenarios.  The  three  levels  arc  as  follows: 

•  ‘No  risk’:  the  required  force  elements  arc  the  sum  of  the  scenario  requirements,  including 
rotations,  i.e.,  if  scenario  i  requires  three  force  elements  of  type  x  with  a  4: 1  rotation  ratio  and 
scenario  j  requires  two  force  elements  of  type  x  with  a  3: 1  rotation  ratio,  the  total  number  of 
force  elements  of  type  x  required  for  scenario  i  and  j  concurrently  is  3  •  (4  +  1 )  +  2  •  (3  +  1 )  = 
23; 

•  ‘Force  Generation  (low)  risk’ :  the  required  force  elements  arc  the  sum  of  the  scenario  require¬ 
ments,  however  this  may  be  reduced  by  employing  rotations  from  a  scenario  within  another 
scenario14,  i.e.,  if  scenario  i  requires  three  force  elements  of  type  x  with  a  4:1  rotation  ratio 
and  scenario  j  requires  two  force  elements  of  type  x  with  a  3:1  rotation  ratio,  scenario  j  may 
employ  two15  rotations  from  scenario  i,  thus  reducing  the  total  number  of  force  elements 
required  to  17  (23  —  3  •  2  =  17);  and 

•  ‘Force  Generation  and  Operational  (medium)  risk’ :  the  required  force  elements  are  the  sum  of 
the  scenario  requirements,  however  this  may  be  reduced  by  employing  rotations  in  a  similar 
fashion  to  the  ‘Force  Generation  risk’  assumptions,  although  with  fewer  restrictions16. 

The  concurrent  force  element  requirements  within  a  single  time  period  arc  summarized  as  force 
structure  deficiencies  and  adequacies,  for  various  scenario  combinations  and  risk  levels,  as  shown 
in  Figure  8.  This  example  shows  the  three  risk  levels  for  four  combinations  of  scenarios,  where 
each  combination  of  scenarios  show  three  rows:  the  top  row  represents  ‘No  risk’  ,  the  middle  row 
represents  ‘Low  risk’,  and  the  bottom  row  represents  ‘Medium  risk’.  For  each  risk  level/concurrent 
scenario  combination  the  green  region  represents  the  percentage  of  force  elements  that  arc  able  to 
meet  the  concurrent  demands,  the  red  region  represents  the  percentage  that  are  no  able  to  meet  the 
concurrent  demands,  and  the  yellow  region  shows  the  percentage  that  transition  from  red  to  green 
through  incurring  a  given  level  of  risk.  As  an  example,  the  percentage  of  force  elements  that  arc  not 

14It  should  be  noted  that  currently  only  the  ‘Baseline’  scenario,  i.e..  daily  domestic  CF  responsibilities,  may  employ 
rotations  from  another  scenario  at  the  ‘Force  Generation  risk’  level.  For  more  information,  the  reader  should  consult 
Pelletier  [11], 

15It  should  be  noted  that  at  least  one  rotation  must  not  be  employed,  e.g.,  a  4:1  rotation  ratio  may  provide  up  to  two 
force  elements  rotations,  a  3:1  rotation  ratio  may  provide  up  to  one  force  element  rotation. 

16Whereas  the  ‘Force  Generation  risk’  level  may  only  employ  rotations  from  other  scenarios  in  the  ‘Baseline’  sce¬ 
nario,  the  ‘Force  Generation  and  Operational  risk"  may  employ  ‘Baseline’  scenario  rotations  in  ‘Domestic/Continental’ 
scenarios  or  non-rotated  ‘International’  scenarios. 
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able  to  meet  the  concurrent  demands  for  the  lower  combination  of  three  scenarios  given  ‘No  risk’ 
is  approximately  28%.  This  output  is  used  by  subject  matter  experts  to  create  the  risk  outlook  [10], 
which  describes  the  risk  of  the  CF  not  being  able  to  create  the  concurrent  mission  effects  over  time. 
An  example  of  a  risk  outlook  is  shown  in  Figure  9,  where  red  means  that  there  is  a  high  likelihood 
of  failure,  yellow  means  that  there  is  a  chance  of  failure,  and  green  means  that  failure  is  unlikely. 
The  numbers  across  the  top  of  the  figure  represent  the  time  period,  i.e.,  year.  It  should  be  noted  that 
the  risk  outlook  assumes  the  ‘No  risk’  risk  tolerance  level. 


Force  Structure  Concurrency  Analysis 

Multiple  Lines  of  Operation  With  Risk 


■  %  FE  Sufficient  Capacity  □%  FE  Sufficient  Capacity  (with  mulit-role)  n%  FE  Insufficient  Capacity 


0%  25%  50%  75%  100% 


(1)  Baselines 


(1)  Baselines  +  Natural  Disast 


(1)  Baselines  +  Natural  Disast  +  Maj  Inti  Op 


(3)  Baselines  Natural  Disast  +  Maj  Inti  Op  +  Sm 
Inti  Op 


Figure  8:  Example  of  force  element  deficiencies  and  adequacies  in  concurrent  scenarios. 
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Figure  9:  Example  of  the  risk  outlook. 


The  Concurrency  method  was  not  included  in  the  first  generation  analytical  process.  While  it  has 
long  been  recognized  that  concurrency  analysis  is  an  important  element  of  the  CBP  analytical  pro¬ 
cess  [13],  due  to  aggressive  timelines  and  resource  constraints  the  concurrency  method  was  not 
developed  until  the  second  generation.  For  more  information  regarding  the  Concurrency  method 
see  [11]  and  regarding  the  risk  outlook  see  [10]. 
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3.5  Optimization 


The  optimization  component  of  the  CBP  analytical  process  provides  the  ability  to  search  the  solution 
space  for  non-dominated  sets17  of  solutions  that  best  address  the  identified  capability  deficiencies, 
where  a  solution  is  comprised  of  a  set  of  capability  investment  alternatives  [9,  10].  The  capability 
investment  alternatives  arc  described  by  a  variety  of  parameters,  however  the  parameters  employed 
in  the  optimization  arc  as  follows18:  degree  to  which  the  alternative  addresses  its  capability  defi¬ 
ciency;  equivalent  annual  cost19;  personnel  requirements;  and  dependencies  on  other  deficiencies 
and  alternatives.  Thus,  the  objective  of  the  optimization  is  to  determine  non-dominated  solutions 
that  provide  maximum  military  value  for  minimum  equivalent  annual  cost,  where  military  value  of 
an  individual  alternative  is  based  on  the  importance  of  the  capability  deficiency  it  addresses,  i.e., 
the  importance  is  related  to  the  CATCAM  scores  of  the  capability  framework  elements  that  the  de¬ 
ficiency  represents,  the  alternative’s  ability  to  address  its  capability  deficiency,  and  the  presence  of 
other  specified  deficiencies  and  alternatives  in  the  solution.  As  well,  the  feasibility  of  a  solution  is 
limited  by  a  set  of  constraints,  primarily  the  number  of  military  personnel  required.  As  a  result  of 
the  dependencies  between  alternatives  in  a  solution,  the  objective  function  for  the  military  value  is 
modeled  by  a  nonlinear  equation,  and  thus  a  heuristic  is  used  to  determine  the  non-dominated  set  of 
solutions. 

As  with  any  heuristic,  the  non-dominated  set  found  is  not  guaranteed  to  be  the  Pareto-optimal  set20. 
An  example  of  a  non-dominated  and  Pareto  front,  i.e.,  the  solutions  of  each  set  exist  on  their  re¬ 
spective  fronts,  arc  shown  in  Figure  10.  As  such,  without  a  guaranteed  upper  bound  on  military 
value  as  a  function  of  cost,  there  is  no  indication  as  to  the  quality  of  the  non-dominated  solutions. 
While  the  heuristic  employed,  i.e.,  constrained  multi-objective  genetic  algorithm21  in  the  second 
generation  has  not  been  modified  as  compared  to  its  first  generation  implementation,  the  quality 
of  the  solutions  generated  have  been  investigated.  Three  avenues  were  undertaken:  generation  of 
solutions  using  a  constrained  single  objective  genetic  algorithm,  evaluation  of  the  algorithmic  pa¬ 
rameters,  e.g.,  population  size,  mutation  rate,  of  the  multi-objective  genetic  algorithms  to  determine 
their  effect  on  the  algorithm's  efficacy,  and  comparison  with  solutions  determined  using  a  second 
single  objective  heuristic  based  on  an  iterated  local  search.  With  respect  to  the  first  items,  the  con¬ 
strained  multi-objective  genetic  algorithm  was  converted  into  a  constrained  single  objective  genetic 
algorithm,  such  that  cost  was  a  constraint  rather  than  an  objective.  The  cost  constraint  was  set  at 
various  values  and  the  determined  solutions  were  compared  to  those  found  using  the  constrained 
multi-objective  genetic  algorithm.  As  well,  the  solutions  were  used  to  seed  the  initial  population  of 
the  constrained  multi-objective  genetic  algorithm  in  an  effort  to  direct  it  towards  a  feasible  region 

17  Among  a  set  of  solution  P,  the  non-dominated  set  of  solutions  P'  are  those  that  are  not  dominated  by  any  member  of 
the  set  P  [16].  When  comparing  two  solutions  pT  and  p(2\  pT  is  said  to  dominate  pA  if  it  is  no  worse  in  all  objectives 
and  it  is  better  in  at  least  one  objective. 

’"Parameters  other  than  those  in  the  list  are  collected,  such  as  risk,  e.g.,  technology,  implementation,  and  accuracy  of 
cost. 

19  The  equivalent  annual  cost  of  a  capability  investment  alternative  includes  several  factors,  such  as  acquisition  cost, 
military  and  civilian  personnel  salaries,  indirect  cost  for  procurement,  operations  and  maintenance,  equipment  support, 
basing,  and  research  and  development  [10]. 

20The  non-dominated  set  of  the  entire  feasible  search  space  5  is  the  globally  Pareto-optimal  set  [16]. 

2 ’The  genetic  algorithm  was  implemented  using  the  Phoenix  Integration  Software  -  see 
http ://www. phoenix- int .com/. 
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quickly  and  reduce  computational  time22.  Through  these  three  avenues  the  following  was  deter¬ 
mined:  the  constrained  single  objective  heuristic  generated  solutions  comparable  to  the  constrained 
multi-objective  genetic  algorithm;  injection  of  good  solutions  in  the  initial  population  decreased  the 
computational  time  of  the  constrained  multi-objective  genetic  algorithm,  however  this  did  not  result 
in  dramatically  better  solutions;  the  efficacy  of  the  algorithm  was  not  significantly  affected  by  the 
choice  of  parameters;  and  the  second  single  objective  heuristic  generated  comparable  solutions  to 
the  constrained  multi-objective  genetic  algorithm.  Thus,  while  the  Pareto  set  was  not  determined, 
the  confidence  in  the  quality  of  the  solutions  has  been  increased. 


Figure  10:  Example  of  a  non-dominated  from  and  a  Pareto  front. 


3.6  Cost  Sensitivity 

While  the  optimization  component  of  the  CBP  analytical  process  determines  non-dominated  so¬ 
lutions,  i.e.,  sets  of  capability  investment  alternatives,  at  various  equivalent  annual  costs,  it  does 
not  investigate  the  risk  of  delivering  the  solutions  due  to  cost  risk.  This  is  accomplished  through 
a  follow-on  process:  cost  sensitivity.  Given  that  the  equivalent  annual  cost  of  each  capability  in¬ 
vestment  alternative  exists  within  a  distribution,  i.e.,  the  lower  and  upper  bounds  of  the  equivalent 
annual  costs  provided  for  each  alternative  arc  assumed  to  form  a  triangular  distribution,  this  infor¬ 
mation  may  be  utilized  to  provide  further  insight  into  the  cost  risk  of  each  solution,  such  as  the 
probability  that  a  solution  will  not  exceed  a  given  funding  limit,  i.e.,  solution  x  has  an  equivalent 
annual  cost  c,  however  there  is  a  probability  p  that  the  cost  will  not  exceed  a  cost  of  k.  An  example 
of  this  type  of  analysis  is  shown  in  Figure  1 123,  where  the  triangles  (yellow  line)  represent  the  per¬ 
centage  of  maximum  military  value  delivered,  i.e.,  the  non-dominated  solutions  in  Figure  10,  and 

22  A  single  ran  of  the  first  generation  constrained  multi-objective  genetic  algorithm  required  approximately  24  hours  to 
perform  a  single  run. 

23This  figure  was  provided  by  Mr.  Leonard  Kerzner. 
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the  squares  (purple  line)  represent  the  probability  that  the  non-dominated  solution  is  achievable  for 
a  given  funding  limit.  While  other  types  of  analyses  exist  within  the  cost  sensitivity  component, 
the  analysis  shown  in  Figure  1 1  is  representative  of  the  type  of  information  obtained  from  the  cost 
sensitivity  analysis. 


Figure  1 1:  Probability  of  solution  delivery  as  a  function  of  equivalent  annual  cost  given  a  funding 
limit. 


The  information  generated  through  the  cost  sensitivity  analysis  aids  decision-makers  in  selecting 
a  solution  from  those  determined  through  the  optimization  process.  The  selected  solution,  subject 
to  changes  by  decision-makers,  i.e.,  due  to  strategic  or  political  guidance,  is  the  approved  set  of 
capability  investment  alternatives  and  is  one  of  the  key  inputs  to  the  SCR.  Following  the  approval 
of  the  solution,  each  alternative  is  mapped  to  a  set  of  tangible  projects.  These  projects,  rather  than 
the  capability  investment  alternatives,  form  a  portion  of  the  input  to  the  investment  plan. 

The  purpose  of  the  cost  sensitivity  component  within  the  CBP  analytical  process  was  not  altered  be¬ 
tween  the  first  and  second  generation,  however  the  implementation  of  the  component  was  changed. 
Cost  sensitivity  in  the  first  generation  was  performed  using  a  Monte  Carlo  simulation  [10],  where 
the  approximation  of  the  cost  distribution  of  a  solution  was  determined  through  sampling  the  cost 
distributions  of  its  alternatives.  While  this  is  a  valid  method  to  perform  this  type  of  analysis,  the 
second  generation  employed  the  mathematical  properties  of  the  capability  investment  alternatives’ 
triangular  distribution  within  a  solution  and  curve  fitting  to  calculate  its  approximate  cost  distri¬ 
bution.  The  primary  difference  between  these  two  approaches  is  that  the  first  generation  method 
employs  a  stochastic  algorithm,  while  the  second  generation  method  employs  a  deterministic  algo¬ 
rithm. 
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4  Conclusion 


In  this  technical  memorandum  the  second  generation  CBP  analytical  process,  which  exists  within 
the  CF  FD  process,  was  presented.  An  overview  of  each  method  within  the  process  was  discussed 
with  an  emphasis  on  how  the  methods  work  together  and  their  modifications  since  the  first  gen¬ 
eration.  The  second  generation  operational  research  tools,  their  objective,  inputs  and  outputs,  and 
summary  of  modifications  since  the  first  generation  arc  summarized  in  Table  1 . 

Table  1:  Summaiy  of  CBP  analytical  process  methods. 

Method 

Objective 

Inputs 

Outputs 

Modifications 

CATCAM 

Evaluate  and  prioritize  ca¬ 
pability  framework  elements 
within  force  planning  scenar¬ 
ios. 

Capability  frame¬ 
work.  scenario  ef¬ 
fects’  weighting 

Prioritized  capabil¬ 
ity  framework  ele¬ 
ments  for  each  sce¬ 
nario 

Ability  to  analyze  Ac¬ 
tivity  and  Subactivity 
capability  framework 
levels. 

sc2rat 

Assign  force  elements  to  ca¬ 
pabilities  and  generate  capa¬ 
bility  outlook  for  each  sce¬ 
nario 

Prioritized  capa¬ 
bility  framework, 
force  elements, 

rotation  ratios 

Required  force  ele¬ 
ments  and  capabil¬ 
ity  outlook  for  each 
scenario 

Replaces  FoRGE,  Ca¬ 
pability  Outlook  tool, 
and  ANDREW 

Concurrency 

Determine  force  element 
requirements  for  concurrent 
scenarios  and  force  structure 
deficiencies  and  adequacies 

Required  force  ele¬ 
ments  for  each  sce¬ 
nario,  rotation  ra¬ 
tios 

Force  structure  de¬ 
ficiencies  and  ade¬ 
quacies 

Not  included  in  previ¬ 
ous  generation 

Optimization 

Determine  sets  of  non- 

dominated  investment  alter¬ 
natives  that  maximize  the 

closure  of  force  structure 
deficiencies  and  minimize 

cost 

Investment  al¬ 
ternatives  and 

constraints 

Non-dominated  sets 
of  investment  alter¬ 
natives 

No  modifications  to  the 
optimization  algorithm 
itself,  however  the  qual¬ 
ity  of  solutions  has  been 
investigated 

Cost  Sensi¬ 
tivity 

Determine  risk  of  delivering 
non-dominated  solutions  due 
to  cost  risk 

Non-dominated 
solutions,  lower 

and  upper  cost 
bounds  for  each 

investment  alterna¬ 
tive 

Probability  of  so¬ 
lution  delivery  for 
varying  cost 

Deterministic  algorithm 
to  determine  cost  dis¬ 
tributions  rather  than  a 
stochastic  algorithm 
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